The effects of interaction on quantum spin Hall insulators 
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We study the -conserving quantum spin Hall insulator in the presence of Hubbard U from a 
field theory point view. The main findings are the following. (1) For arbitrarily small U the edges 
possess power-law correlated antiferromagnetic XY local moments. Gapless charge excitations arise 
from the Goldstone-Wilczek mechanism. (2) The decaying exponent of the XY correlation is > 2 
hence normally space-time vortices should proliferate. (3) For thermodynamic samples, vortex 
proliferation is prohibited by the conservation of edge charge. (4) For a sample with finite width 
electron tunneling between opposite edges allows vortex proliferation hence is a strongly relevant 
perturbation (more relevant than in the non-interacting theory). (5) The phase transition between 
the antiferromagnetic and the topological insulating phases is triggered by the condensation of 
magnetic excitons. 

PACS numbers: 74.20.Mn, 74.72.-h, 74.25. Gz 



The subject of topological insulator (TI) has attracted 
considerable attention recently [1. A signature of this 
type of band insulator is the presence of itinerant bound- 
ary states in the bulk band gap. Moreover, unlike those in 
usual band insulators, these itinerant in-gap states are ro- 
bust against any modification of the free-electron Hamil- 
tonian so long as they (i) respect time reversal symme- 
try, and (ii) do not close the bulk bandgap. For example, 
three dimensional TIs possess in-gap surface states whose 
dispersion consists of an odd number of Dirac cones [2j|3]. 
Because of the robustness, these surfaces states can evade 
Anderson's localization in the presence of (time-reversal 
invariant) disorder [4 . As another example, two dimen- 
sional TIs (or the quantum spin Hall insulator (QSHI)) 
possess odd pairs of time-reversal conjugate, counter- 
propagating, edge states [SHE] - the "helical edge modes". 
At the present time non-interacting TIs are fairly well 
understood. What remains open is the effect of electron- 
electron interaction on TIs [9]. 

Recently two independent Monte-Carlo simulations [10 , 
[TT] were performed on the simplest kind of interacting 
QSHI. The Hamiltonian studied in these works is Hq + 
H u where Hq is the 5^ -conserving free electron model 
introduced by Kane and Mele[5 : 

H = {-^2 c t c 3cr +it f J2 a v i3 c t c jcr}- (1) 

Here z, j label the sites of a honeycomb lattice, the first 
term describes the nearest neighbor hopping, and the sec- 
ond term is a spin dependent second neighbor hopping. 
Here Uij = {d\ xcfeWKdh. x ^2)^| where d\ and are unit 
vectors along the two bonds the electron traverses when 
hopping from j to i. H u is given by H u = U^i n A n i- 
According to Ref.QU], for t' > 0.03 (see Fig. @) there 
are only two phases as a function of U. The large U phase 
is an easy-plane (XY) antiferromagnetic (AF) Mott insu- 
lator; at small U it is an (interacting) QSHI with gapless 
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FIG. 1: (color on-line) (a) The spin-Hall insulator defined on 
a cylinder with height h. The blue/red bonds denote the 
nearest /second neighbor hopping, (b) When the cylinder is 
short, the electron can directly tunnel from one edge to the 
other. 



spin and charge edge excitations. 

The present work is motivated by the following consid- 
erations. Consider a system with edges (Fig. ([I]) (a)). At 
small U the bulk is free of the magnetic moment and is a 
band insulator. At U = the low energy excitations are 
the helical edge modes described by the following Hamil- 
tonian 

H E o = Tiv J dxV+<r g d x V, (2) 

where =p applies to the top/bottom edges. In Eq. ([2| 
v is the edge velocity (which will be set to 1 in the 
rest of the paper), and ^ is a two component fermion 
field whose first/second component corresponds to spin 
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up/down. In mean-field theory the Hubbard U intro- 
duces a mass term - the AF XY order parameter. Be- 
cause the non-interacting theory has a logarithmically 
diverging susceptibility with respect to this order param- 
eter, mean-field theory predicts AF XY ordered edges for 
arbitrarily small positive U. Of course, such order is de- 
stroyed by spin wave fluctuations; after that time reversal 
symmetry is restored. The resulting magnetic edges have 



power-law decaying AF XY correlation. Since these mag- 
netic edge are quite different from the gapless edges in 
the non-interacting theory, it is interesting to ask in what 
sense is the resulting state a topological insulator. 

We start by studying the effects of Hubbard U in mean- 
field theory. Among all possible quadratic factorization, 
the following AF XY decoupling (the fact that AF is 
favored is dictated by the edge wavefunctions) 



u J2 ( c it c a 



(3) 



leads to a "mass term" of the free theory. In the presence 
of the XY order parameter the mean-field edge Hamilto- 
nian read 

H E0 -m [cos/9 J dx^a x ^ + sin<9 J dx^cr y ^}. (4) 

Since the free theory has a log-divergent susceptibility 
with respect to this order parameter, an infinitesimal pos- 
itive U induces the formation of the edge AF moments. 
We check this prediction by performing a mean-field cal- 
culation on a finite cylinder for t' — 0.2 and < U < 5 
(this corresponds to the cut associated with the blue line 
interval in Fig. Q). The results are shown in Fig. (J2|; 
from which it is clear that while the order parameter 



deep in the bulk (the blue curve) vanishes for U < 3, 
the edge order parameter (the red curve) survives to the 
lowest U value. Thus for small U, mean-field theory pre- 
dicts a one dimensional XY ordered antiferromagnetic at 
each (zigzag) edge. Spin waves destroy the long-range 
order and render the edge AF XY correlation power-law 
decaying. As a consequence time reversal symmetry is 
restored. However since the local moments introduces 
a single particle gap, one might wonder where are the 
gapless charge excitations. 

In the presence of orientation fluctuations of the mag- 
netic moments, in Eq. Q becomes position and time 
dependent. To describe that situation we need to replace 
Eq. Q by the following action 



s E = J dxd t { m* T i*+* z a x *-rn C o S e M *V B *_ roBin , (a , t) * v „* } . 



(5) 
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Using the method of Abanov and Wiegmann[12] we have 
derived the stiffness term 
K 



dxdt \{dtoy + (d x ey 
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by integrating out the fermions. The stiffness constant 
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(here A is a momentum cutoff) hence is less or equal 
to 1/47T. The same result can be easily derived using 
bosonization in the A — »• oo limit. This implies the XY 
correlation function 

( e ifl(0,0) e -tf(*,t)) „ (x 2 + fyl/toK (8) 

decays faster than the Kosterlitz-Thouless bound (x 2 + 
t 2 )~ 1 / 4 [13]. Hence normally one would expect the power- 
law ordered AF edges to be unstable with respect to the 



proliferation of space-time vortices (vortex instantons). 
If so the edges will possess spin gaps. 

In Ref.[l4] Goldstone and Wilczek showed that after 
integrating out the gapped fermions in Eq. ([5]), d x 6 and 
d t gain coupling to the electromagnetic gauge field and 
the total effective action looks like 



-I 



dxdt {y(^#) 2 
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(A d x 6-A x d t 6)}. (9) 



The last two terms of Eq. ([9| imply the space and time 
gradients in produce excess charge and current densities 
at the edges: 
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(10) 



Here e is the electron charge. Because of Eq. (10) gapless 



spin wave excitations induce charge and current density 
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FIG. 2: (color on-line) (a) The mean- field antiferromagnetic 
XY order parameter as a function of z (see Fig. Q(a) and 
U. The calculation is done for a cylinder with 35 unit cell 
in the periodic direction and 40 unit cells in the z direction. 
The value t' is 0.2. (b) The order parameter as a function 
of U deep in the bulk z — 20 (blue), and at the edge z — 1 
or 40 (red). It is clear that while the order parameter in the 
bulk vanishes for U < 3 (the small rounding is due to finite 
size effect), the edge order parameter survives to the lowest 
U value. 



fluctuations with the following correlation functions 
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Thus gapless charge excitations emerge. 

Because of Eq. ( p~Q| ) a, e.g., a vorticity-m instanton at 
the space-time location (#o,£o) w ^ cause 
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Here D is an arbitrary disk containing (xq, to) and Je,h 
(pEj Je) is the edge 2-current. Eq. ([12]) implies 



d t pE + d x J E = -me S(x - x )S(t - t ), (13) 

hence vortex instantons violate the edge charge conser- 
vation. Nonetheless such instantons can occur through 
the the tunneling of electrons from one edge to the 
other US (Fig. 0(b)). Of course the amplitude of such 
tunneling is suppressed exponentially as a function of the 
cylinder height h. As a result the edge spin gap will be 
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FIG. 3: (color on-line) An example of the XY order parameter 
profile associated with a localized magnetic exciton . The size 
of the red circles is proportional to the magnitude of the order 
parameter. 



proportional to e~ ah , which is not so different from the 
free electron case (only the a value is affected by the 
degree of relevance of the electron tunneling). 

In the h oc limit the (interacting) QSHI phase ex- 
hibits quantized spin-Hall conductance. This can be un- 
derstood as follows. In the presence of an electric field 
between the two edges, a voltage difference V develops. 
This induces a difference in d x between the two edges 
(Ei and E 2 ) 



(d x 6) El - (d x 0) E2 



eV 
2^K' 



Because the spin current is Kd x 6, this gives 
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(14) 



(15) 



hence the spin Hall conductance is ^ which is the same 
as the free electron value. 

Finally we consider the bulk transition between the AF 
Mott insulator and the QSHI. Let's starts from the QSHI 
phase. For this discussion let's use the periodic boundary 
condition. Let us consider, e.g., the blue cut in Fig. Q. 
First we approach the Mott insulator from the QSHI side. 
In the presence of U its lowest-energy exciton is magnetic 
(we don't use the word "triplet" because SU (2) is broken 
by the spin-orbit hopping down to U(l)). An example of 
the XY order parameter profile associated with a mag- 
netic exciton is shown in Fig. (J3|. Now let's increase U. 
The transition into the AF insulator is triggered by the 
condensation of magnetic excitons. At the transition the 
modulus and the phase coherence of the AF XY magnetic 
order parameter form simultaneously. 
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FIG. 4: (color on-line) A schematic reproduction of the phase 
diagram of the Ho + H u reported in Ref . [10] . The blue cut is 
considered in the text. 



It is also instructive to approach the transition from 
the AF Mott insulator side. In this case one natu- 
rally expects the XY order to be destroyed by the con- 
densation of vortices. Because the AF XY order pa- 
rameter, the triplet superconducting order parameter 
and the quantum spin Hall order parameter (which in- 
troduces the spin-dependent hopping term in Eq. ([I])) 
form a Wess-Zumino-Witten five-tuplet for the free- 
graphene bandstructure[16], one expects the following 
charge density-skyrmion density relation [T2] 

9 = ^-£abcn a d x n b d y n c . (16) 

Z7T 

Here n 1 ' 2 ' 3 is the unit vector associated with the order 
parameter triad formed by the quantum spin Hall and the 
AF XY order parameters. The vortex charge is therefore 
proportional to ni(l — n\). Since n\ = 1 (the modulus of 
the XY order parameter vanishes) at the Mott to quan- 
tum spin Hall insulator transition, hence the condensed 
vortices are charge neutral. As a result, the vortex con- 
densed phase can be an insulator. In addition, since the 
modulus of the XY order parameter vanishes at the tran- 
sition the vortices do not see a background magnetic flux 
which frustrate the vortex condensation. This implies the 
universality class of the transition is three-dimensional 
XY like as claimed in Ref. [TO] . 

In summary, despite the apparent difference, the 
power-law correlated antiferromagnetic XY edges do ex- 
hibit properties expected for the quantum spin Hall in- 
sulators. The essential physics is the Goldstone-Wilczek 
mechanism; through which the space-time gradients of 
the phase angle of the XY order parameter are propor- 
tional to the charge and current densities. The space- 
time vortices of the XY order parameter violate edge 



charge conservation hence are prohibited in thermody- 
namic samples. This is the mechanism through which 
the gapless charge and spin excitation are protected at 
the edges. At the moment we do not have a good picture 
for the "spin liquid dome" in Fig. Q. The main findings 
of this paper are summarized in the abstract. 
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